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FOREVORD 


This  pi^licstion  hat  been  prepared  as  a  means  of  providing  a  view  of  the 
enlisted  selection  and  classification  ptocess-the  tests  in  being,  how  they  are 
assembled,  aho  develops  them,  the  way  that  scores  are  actually  used,  the  effi¬ 
ciency  of  the  tests,  and  some  research  that  backs  up  successive  forms  of  a  test. 
The  material  has  been  compiled  largely  from  other  publications  issued  by  the 
Personnel  Research  Laboratory  and  its  predecessor  Air  Force  organizations. 
Personal  credits  to  the  authors  of  these  reports  appear  throughout  this  paper. 


ABSTRACT 


Aptitude  teats  have  been  used  since  1948  to  aid  in  selecting  and  assigning 
enlistees  to  the  training  for  which  they  are  best  suited  by  ability  and  education. 
By  this  means  the  Air  Force  seeks  to  reduce  the  cost  of  training  and  realize  com¬ 
petent,  well-satisfied  career  airmen.  This  survey  traces  the  history  of  airman 
aptitude  testing,  tells  how  effective  tests  are  identified,,  how  the  tests  are  assem¬ 
bled,  and  how  the  scores  are  used.  The  present  Airman  Qualifying  Examination  is 
described  and  compared  with  other  latitude  test  batteries.  The  role  of  research  in 
seeking  out  more  effective  techniques  of  personnel  selection  and  assignment  is 
emphasized,  with  illustrations  from  ongoing  studies. 
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SURVEY  OF  TESTS  USED  IN  AIRMAN  CLASSIFICATION 


INTRODUCTION 

In  the  past  few  years,  and  particularly  since  early  1958  when  a  program  of  selective 
recruiting  was  initiated,  an  increasing  number  of  people  have  become  more  directly  involved 
with  the  United  States  Air  Force  program  of  testing  enlisted  personnel  for  selection  and  clas¬ 
sification  purposes.  Vhen  this  testing  was  a  part  of  the  early  processing  of  a  new  recruit  at 
the  basic  military  training  center,  a  limited  number  of  persons  were  directly  concerned  with 
the  tests,  their  admijiistration  and  use.  In  April  1958,  the  USAF  Recruiting  Service  was 
given  responsibility  for  selective  recruiting.  Administration  and  scoring  of  selection  and 
classification  tes  ts  was  made  a  part  of  that  nission.  In  the  interests  of  obtaining  the  best 
q  ualified  individuals  for  enlistment  in  the  Air  Force,  the  Recruiting  Service  has  approached 
'  many  persons  in  communities  across  the  United  States  for  assistance.  To  some  of  the  se 
*  people,  the  tests  used  by  the  Air  Force  to  select  the  best  potential  enlistees  from  among  the 

many  possible  applicants  are  an  unknown  quantity. 

A  product  may  sell  once  because  of  a  fancy  package  or  through  an  intensive  advertising 
campaign,  but  it  gets  repeat  sales  because  of  its  own  merits.  For  those  readers  who  want  to 
know  more  about  the  Air  Force  classification  tests  this  report  has  been  prepared  to  show 
some  of  the  "inside  of  the  package."  The  material  has  been  collected  into  four  major  areas. 
Section  1  is  directed  to  a  brief  history  of  the  testing  program.  Section  2  relates  the  Air  Force 
tests  and  jobs  to  the  civilian  technology  and  commercial  tests.  Section  3  gives  some  techni¬ 
cal  data  for  the  Air  Force  test  batteries.  Section  4  looks  at  research  in  progress  that  pro¬ 
vides  inputs  for  revision  of  the  tests  to  come.  The  report  wi^  answer  such  questions  as; 

"Why  does  the  Air  Force  test  a  potential  enlistee?"  "Who  builds  the  tests?"  •'How  are  they 
built?"  "How  are  the  scores  used?" 

SECTION  1.  ORGANIZATION  AND  PERSONNEL 

Historical  AnItctJsnis 

The  airman  classification  program  of  the  1960’s  traces  its  ancestry  to  the  aviation 
'  cadet  program  of  the  1940’a.  From  the  Array  Air  Forces  Aviation  Psychology  Program  of 

World  War  II  came  a  number  of  the  techniques  and  test  ideas  on  which  the  present  Airman 
Classification  Test  and  the  Airman  Qualifying  Examination  are  based.  From  the  integrated 
research  and  development  program  on  iq>titude  tests  for  classification  of  aircrew  personnel 
started  in  1941  there  has  been  continuity  to  the  present  day  of  an  Air  Force  organization 
engaged  in  personnel  research;  as  a  matter  of  fact,  a  few  of  the  workers  in  the  World  War  II 
program  are  today  still  active  in  the  test  research  and  development  program  of  the  Air  Force. 

The  Personnel  Research  Laboratory  is  the  Air  Force  research  unit  for  personnel  meas¬ 
urement  and  evaluation  and  is  under  the  Air  Force  Systems  Command.  It  is  of  considerable 
significance  that  this  activity  represents  the  thread  of  continuity  from  the  Aviation  Psy¬ 
chology  Program  of  World  War  II  through  the  postwar  years  to  the  present  time.  In  spite  of 
the  many  organizational  changes  and  budgetary  considerations,  the  Personnel  Research  Labo¬ 
ratory  has  maintained  its  mission,  status,  and  scientific  environment  since  1946.  There  have 
been  fluctuations  in  the  level  of  operating  resources,  but  the  building  of  tests  for  use  in  the 
selection  and  classification  of  Air  Force  officer  and  enlisted  personnel  has  been  the  core  of 
laboratory  activity. 
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Tb*  Pftstnt  Staff 

A  major  factor  in  this  continuity  may  be  attributed  to  the  professional  and  scientific 
background  of  the  individuals  on  the  staff.  The  philosophy  of  a  maximum  of  professional 
training  in  psychology  and  education  defined  in  the  manning  of  the  Psychological  Research 
Units  in  1941  established  a  precedent  that  has  carried  through  to  the  present.  Whether  mili¬ 
tary  or  civilian,  most  persons  engaged  in  the  direction  of  test  research  and  development  have 
had  not  less  than  an  MA  degree  with  a  major  in  Psychology  or  Education  and  many  have 
earned  the  PhD  degree  from  recognized  American  universities.  In  the  period  from  1946  to 
1952,  much  of  the  writing  of  test  items  was  done  by  the  in-service  staff;  in  more  recent  years , 
quantities  of  test  items  for  the  various  types  required  for  selection  and  classification  batter¬ 
ies  have  been  obtained  through  research  and  development  contracts  with  agencies  such  as 
Test  Research  Service  (New  York),  Human  Factors  Research  (Los  Angeles),  Science  Research 
Associates  (Chicago),  and  Educational  Testing  Service  (Princeton).  On  two  occasions  the  test 
batteries  were  developed  under  contract;  the  Airman  Classification  Battery,  Form  AC-IC,  was  • 
built  by  the  Educational  Testing  Service  and  the  Airman  Qualifying  Examination,  Form  62,  was 
assembled  by  the  American  Institute  for  Research. 


SECTIOS  2.  AIR  FORCE  TESTS  RELATED  TO  CIVILIAN  TESTS 
Factor  Approach  to  Classification  Tests 

The  airman  selection  and  classification  tests  have  been  oriented  toward  the  objective  of 
providing  measures  of  ^titude  for  predicting  completion  of  technical  training.  The  development 
of  the  first  Airman  Classification  Battery  was  based  on  two  premises;  (a)  that  each  job  spe¬ 
cialty,  designated  by  an  Ait  Force  Specialty  Code  (AFSC),  requites  a  differen  t  combination  of 
aptitudes  for  success;  and  (b)  that  this  specific  combination  of  aptitudes  wall  better  predict 
succe  ss  for  a  given  specialty  than  would  a  general  intelligence  or  general  classification  test. 
Although  the  theory  of  a  separate  pattern  of  aptitudes  for  each  job  specialty  (training  course) 
suggests  a  large  number  of  patterns,  in  practice  it  was  found  that  some  of  the  patterns  are 
highly  similar.  Consequently  it  was  possible  to  combine  those  specialties  requiring  similar 
patterns  of  aptitudes  into  homogeneous  clusters  or  groups.  The  earliest  battery  yielded  scores 
for  eight  such  groups;  later  revisions  and  research  reduced  this  number  to  five,  one  of  which 
wa  s  a  highly  specific  set  of  iq>titudes  best  measured  by  inclusion  o  f  some  aural  tests.  The 
pres  e  nt  Airman  Qualifying  Examination,  described  mote  completely  in  a  later  section,  has  com- 
p  o  s  ite  scores  for  four  areas  or  specialty  groupings. 

In  general,  the  tests  comprising  a  battery  were  each  designed  to  measure  a  single  factor, 
insofar  as  this  was  possible.  The  liiflits  of  testing  time  available  required  the  use  of  short  tests 
in  order  to  represent  the  major  factors  that  were  present  in  the  criteria  being  predicted.  It  has 
been  de  monstrated,  however,  that  although  the  reliability  of  any  one  short  test  may  be  less  than 
desired,  when  several  short  tests  are  combined  into  a  composite,  the  reliability  of  the  compos¬ 
ite  is  well  within  the  range  of  expected  and  accepted  values  (Brokaw,  1950).  This  principle 
is  used  in  such  commercial  iq>titude  test  batteries  as  the  Employee  Aptitude  Survey  and  the 
Differential  Aptitude  Tests. 

As  a  matter  of  interest,  the  factor  content  of  a  number  of  commercial  tests  is  compared 
with  the  Air  Force  battery  in  Table  1.  It  is  apparent  that  nearly  all  of  these  instruments  are 
similar  in  the  basic  six  or  seven  factors;  the  remaining  factors  tend  to  be  specific  to  particular 
batterie  s.  In  prediction  of  Air  force  technical  training  success,  the  Space  Relations  and  Mem¬ 
ory  factors  have  not  appeared  as  significant  abilities.  Further,  recent  research  suggests  that 
the  Motor  Speed  and  Coordination  factors  cannot  be  measured  adequately  with  paper-and-pencil 
tests  (Fleishman  &  Ellison,  1962).  For  the  general  run  of  the  more  commonly  encountered  Air 
Force  jobs,  the  AQE  represents  a  satisfactory  test  coverage  of  aptitude  factors. 
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TABLE  I.  Faciot  Content  of  Several  Aptitude  Batteries 


msM 

Repotted  Factors 

Battery 

V 

N 

R 

PS 

SV 

FP 

Me 

F 

SR  Mm 

c 

MS 

Airman  Qualifying  Examination 

X 

X 

X 

X 

X 

X 

X 

Detroit  General  Aptitudes  Examination 

X 

X 

X 

X 

X 

X 

X 

X 

Differential  Aptitude  Tests 

X 

X 

X 

X 

X 

X 

X 

Employee  Aptitude  Survey 

X 

X 

X 

X 

X 

X 

X 

Factored  Aptitude  Series 

X 

X 

X 

X 

X 

X 

X 

X 

X  X 

X 

X 

Flanagan  Aptitude  Classification  Tests 

X 

X 

X 

X 

X 

X 

X 

X 

X  X 

X 

X 

Guilford-Zimmerman  Aptitude  Survey 

X 

X 

X 

X 

X 

X 

General  Aptitude  Test  Battery  (USES) 

X 

X 

X 

X 

X 

X 

X 

X 

V  =  Verbal,  N  =  Numerical,  R  =  Reasoning,  PS  =  Perceptual  Speed,  SV  =  Spatial 
Visualization,  FP  =  Form  Perception,  Me  =  Mechanical,  F  =  Fluency,  SR  =  Spatial  Rela¬ 
tions,  Mm  =  Memory,  C  >=  Coordination,  and  MS  =  Motor  Speed. 

How  is  Aptitude  Information  Presented?^ 

Aptitude  indexes  from  the  Airman  Qualifying  Examination  appear  as  a  percentile  type  of 
score,  with  the  potential  mobilixation  population  broken  into  20  equal  parts,  each  covering  S 
perc  ent  of  the  range  of  talent.  The  mobilization  population  refers  to  the  entire  range  of  talent 
available  under  wartime  enlistment  conditions.  Each  such  3-percent  block  is  designated  by  a 
nunber  indicating  the  percentage  of  the  mobilization  population  falling  below  the  block.  For 
this  reason  the  highest  possible  score  is  95,  indicating  the  3  percent  achieving  the  highest 
scores.  The  lowest  possible  score  would  be  zero,  indicating  the  3  percent  block  inferior  to 
the  other  95  percent  of  the  sample.  For  convenience  with  electronic  computing  machines,  the 
lowest  score  is  given  as  01  rather  than  as  00. 

Aptitude  indexes  should  be  interpreted  as  indicating  the  location  of  a  given  individual, 
in  terms  of  the  percentage  of  individuals  who  would  do  less  well,  in  a  mobilization  population, 
within  the  specific  aptitudes  measured  by  the  indexes  under  consideration.  For  example,  an 
individual  with  an  Electronics  index  of  30  is  just  slightly  above  the  average  in  possession  of 
aptitudes  related  to  success  in  electronic  types  of  training;  one  with  an  index  of  80  is  quite 
hig  h  in  aptitude;  one  vith  an  index  of  30  is  quite  low. 

How  Can  Information  About  Aptitude  Indexes  Be  Used? 

The  aptitude  indexes  ate  designed  to  predict  success  in  training  on  an  actuarial  basis. 

As  s  u  ccessively  higher  scores  are  achieved  on  a  given  aptitude  index,  the  probability  of  the 
individual’s  success  in  training  in  that  field  rises.  It  must  be  remembered  that  success  in 
training,  like  success  on  a  given  job,  is  a  function,  not  only  of  aptitude,  but  also  of  motiva¬ 
tion  and  individual  characteristics  of  the  worker  and  of  the  supervisor  or  teacher. 

The  Airman  Classification  Battery  and  the  Airman  Qualifying  Examination  produce  infor¬ 
mation  that  is  almost  entirely  aptitudinal  in  nature.  Interest  and  motivation  toward  success  in 
a  certain  field  is  taken  into  account,  to  some  extent,  by  the  classification  interviewer  at  the 
military  training  center.  If  the  interviewer  is  skillful  in  his  discussion,  and  if  quotas  permit, 
it  is  probable  that  at  the  time  of  assignment  the  airman  was  genuinely  interested  in  the  occupa¬ 
tional  field  to  which  he  is  assigned.  In  such  a  job  his  motivation  should  lead  to  reasonable 
deve  lopment  of  his  aptitude  potential. 

^  This  section  is  based  on  an  unpublished  paper  by  F.D.  Harding  tt  L.D.  Broksw, 

Implications  of  Air  Force  personnel  information  for  job  requirements.  Technical  Memo¬ 
randum  PL-TM-38-3,  February  1938. 
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leaning  of  the  Aptitud*  Indoxoa 

The  Mechanical  Aptitude  Index  ia  prinarily  based  on  experience  and  interest  in  simple 
mechanical  topics.  Only  those  persons  scoring  high  (80  or  higher)  in  this  index  would  pos- 
s  ess  information  gaine  d  in  elementary  science  courses.  Most  of  the  questions  involve  fac¬ 
tual  knowledge  of  machines  or  mechanical  processes,  some  are  based  on  pictures,  others  on 
verbal  descriptions.  Understanding  of  the  functions  of  the  moving  parts  of  machines  or  of 
the  problems  of  sheet  metal  work  is  assessed  through  questions  covering  relationships  ex¬ 
isting  in  simple  geometric  figures  in  which  various  parts  h  ave  been  transposed. 

It  has  been  found  that  the  low  (scoring  25  or  below)  aptitude  aiimen  in  this  field  de- 
pend  more  on  rote  knowledge  and  less  on  understanding  of  mechanical  principles.  They 
knowhow  to  do  certain  simple  mechanical  tasks,  like  straightening  a  bicycle  wheel  or  low¬ 
ering  its  seat,  but  cannot  follow  the  direction  of  rotation  through  a  gear  train.  Their  vocabu¬ 
laries  are  normally  quite  restricted,  both  for  technical  mechanical  words  and  for  more  liter¬ 
ate  terms. 

The  Administrative  Aptitude  Index  represents  performance  on  tests  which  stress  speedy 
response  to  verbal  and  quantitative  materials.  Also  included  is  a  measure  of  the  knowledge 
of  the  meanings  of  words.  Scores  on  the  Administrative  Index  are  predictive  of  perfohnance  . 
in  clerical  activities  wh  ich  require  attention  to  detail  and  fairly  rapid  work.  In  the  speeded 
test  of  simple  subtraction  and  division,  low  ability  airmen  attempt  only  about  half  the  items 
and  are  quite  inaccurate.  They  also  tend  to  make  more  mistakes  on  division  than  on  the  sub¬ 
traction  problems. 

The  General  Aptitude  Index,  as  its  name  implies,  covers  general  ability  in  much  the 
same  manner  as  did  the  Army  General  Classification  Test  in  World  War  II.  It  is  primarily  a 
measure  of  general  intelligence,  and  properly  is  used  for  assignment  of  men  to  those  several 
fields  which  have  been  found  to  depend  on  balanced  ability  rather  than  high  specialization  in 
certain  aptitudes.  The  indiscriminate  use  of  this  index  for  assignment  purposes  would  result 
in  serious  losses  through  waste  of  talent  of  men  of  unique  capabilities  for  the  more  highly 
specific  fields.  Tests  in  this  measure  include  vocabulary,  arithmetic  reasoning,  and  hidden 
figure  s. 

The  Electronics  Aptitude  Index  is  the  most  technical  in  content,  and  is  well  described 
as  a  measure  of  engineering  aptitude.  It  goes  beyond  informational  material  into  understand¬ 
ing  of  the  fundamentals  of  mechanics  and  electricity,  as  well  as  other  physical  principles. 
Persons  scoring  high  on  this  index  have  demonstrated  knowledge  of  electrical  principles  and 
ability  to  understand  complex  mechanical  designs.  A  high  score  indicates  ability  to  apply 
fractions,  percentages,  and  simple  formulas  in  solving  mathematical  problemir.  The  ability 
to  visualize  the  appearance  of  objects  in  various  positions  and  with  various  changes  in  their 
stru  cture  is  another  important  component  of  the  Electronics  Index. 

The  same  general  characteristics  apply  to  low  aptitude  ainnen  in  this  area  as  in  the 
mechanical  area.  They  tend  to  lack  understanding  of  principles,  and  to  possess  only  frag¬ 
mentary  tote  information;  e.g.,  they  know  how  to  insulate  bare  wires,  and  can  identify  an 
automobile  distributor.  They  tend  to  be  inaccurate  and  careless.  Low  aptitude  airmen,  on 
the  ave  rage,  attempt  to  answer  more  of  the  arithmetic  reasoning  questions  than  do  their  more 
able  fellows;  yet  they  answer  roost  of  the  questions  incorrectly. 

RelationsUp  Batwaen  Aptitude  und  Oecuputionul  Level 

The  question  as  to  just  what  a  person  of  a  certain  aptitude  level  may  be  expected  to 
do  is  difficult  to  answer.  This  is  because  other  factors  besides  aptitude  influence  job  per¬ 
formance.  A  person’s  interests,  attitudes  toward  work,  previous  experience,  kind  of  training 
received,  supervision,  all  play  a  part  in  his  level  of  job  performance. 

Another  factor  which  needs  to  be  considered  is  the  nature  of  the  job  itself.  If  the  work 
is  fairly  standardized  and  does  not  require  learning  from  new  experiences,  then  it  might  be 
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ej^ected  that  lets  able  people  with  additional  training  or  ei^erience  could  perform  aa  well 
aa  tho  ae  who  are  more  intelligent. 

While  there  are  no  atudiea  which  relate  aptitude  levela  directly  to  performance  of  varioua 
taska,  it  is  possible  to  get  indications  of  the  relationship  of  general  intelligence  level  and  oc- 
ci^ational  level.  Pertinent  information  showing  this  relationship  is  presented  in  the  next  two 
tables. 


TABLE  Z  Eatinaited  Level  of  General  Intelligence  Typical  of  Certain  Jobs* 
(Bated  on  ratinge  by  USES) 


General  Aptitude  Index 

Job  Title 

95 

Accountant,  General 

90 

Radio  Enginee  r 

85 

80 

Electrical  Equipment  Tester 

75 

Radio  Operator,  Flight 

70 

65 

60 

Airplane  and  Engine  Inspector 

55 

Office  Machine  ^rviceman 

50 

Radio  Repairman  I 

45 

40 

35 

30 

No  Benchmark  Jobs 

Brief  Job  Descriptions 


Accountant,  General,  Devises  and  installs 
accountins  systems:  Must  be  able  to  sdiust  a 
particular  accountios  system  to  the  needs  of  a 
particular  firm.  Superviaes  subordinates.  Bal¬ 
ances  books  periodically  and  prepares  state¬ 
ments  showini  such  items  at  receipts,  disburse¬ 
ments,  expenses,  and  profit  and  loss.  Prepares 
Federal,  State  or  local  tax  returns. 

Radio  Engineer,  Supervises  operation  of 
technical  equipment  in  a  radio  or  television 
station .  Supervises  maintenance  or  maintains 
station  equipment  in  operation  by  rapid  diag¬ 
nosis,  adjustment  and  repair  of  faults.  De¬ 
velops,  constructs  and  installs  new  equipment 
for  sration. 

Electrical  Equipment  Tetter  (aircraft  mfg). 
Tests  sod  adjusts  electrical  airplane  equipment 
and  accessories  prior  to  installation,  using  spe¬ 
cial  testing  equipment  and  hand  tools.  Removes 
accessories  or  equipment  such  as  solenoids, 
booster  coils,  condensers,  etc.  Connects  soe- 
cial  testing  devices. 

Airplane  and  Engine  Intpeetor.  Checks 
all  parts  and  accessories  of  transport  p  lanes 
before  and  after  flight  and  during  overhaul,  and 


certifies  to  the  airworthiness  of  inspected  air¬ 
planes.  Tries  tightness  of  connections,  checks 
fit  of  parts,  checks  all  factors  which  affect  op¬ 
eration  o  f  aircraft.  Notes  all  repairs  found  nec¬ 
essary  and  rechecks  after  work  is  done.  Cer¬ 
tifies  and  bears  responsibility  for  airworthiness. 

Radio  Operator,  Flight,  Operates  radio  and  di¬ 
rection-finding  equipment  aboard  aircraft  in  flight. 
Maintains  contact  with  ground  stations  by  operating 
radio  sending  and  receiving  equipment  using  hand 
key  and  Morse  code.  Adjusts  transmitters  in  air¬ 
plane  making  minor  repairs  when  feasible.  Inspects 
equipment  on  ground  doing  all  maintenance  work  ex¬ 
cept  major  repairs  using  test  instruments  and  hand 
tools. 

Office  Machine  Serviceman,  Inspects,  adjusts 
and  repairs  office  machines  such  as  adding,  calcu¬ 
lators,  bookkeeping,  multigraph  and  typewriters. 
Diagnoses  the  defect  by  inspection,  by  disassemb¬ 
ling  and  examining  moving  parts. 

Radio  Repairman  /.  Tests  and  repairs  defec¬ 
tive  radios;  tests  circuits,  tubes  and  other  parts 
using  test  meters  and  devices:  Isolates  defects 
and  either  fixes  them  or  replac  es  parts.  Resolders 
loose  connections. 


*  Fion  aa  uapublishcd  paper  by  F.O.  Harding  &  U.D.  Biokaw,  Implications  of  Ait 
Force  petaoaael  iafotmatioa  for  job  tcquiteacats,  Ttchnical  Memorandum  PL-TM-S8-3, 
Ftbtunty  1958. 
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TABLE  },  Typical  Intelligence  Levels  for  Selected  Qvilian  Occupations* 


Occupation 

Appropriate 
General  AI*’ 

Occupation 

Appioptiate 
General  AI 

Chemist 

90 

Airplane  Mechanic 

65 

Draftsman 

85 

Electrician 

65 

Ph  armacist 

85 

Sheet  Metal  Worker 

60 

Tabulating  Machine  Operator 

85 

Plumber 

65 

Installer,  Telephone  and  Telegraph 

75 

Pipefitter 

55 

Instrument  Repairman 

75 

Welder 

55 

Toolmaker 

70 

Tractor  Driver 

50 

Machin  ist 

70 

Crane  Hoist  Operator 

50 

Watchmaker 

65 

*Ftoin  an  unpublished  paper  by  F.D.  Harding  Sc  L.D.  Brolcaw,  Implications  of  Air 
Force  personnel  information  for  job  requirements,  Technical  Memorandum  PL-TM-38-3, 
February  1958. 

^  The  values  presented  here  ate  for  civilian  incumbents  of  these  jobs  and  ate  con¬ 
verted  from  World  Wat  II  studies. 


Description  of  Subtests  in  AQE-P 

Form  F  of  the  Airman  Qualifying  Examination  is  similar  in  subtest  content  to  Form  D  and 
Form 62 (introduced  October  1962).  The  AQE  content  has  followed  that  of  the  more  comprehensive 
Airman  Classification  Batteries,  with  revisions  suggested  as  a  result  of  validation  and  re¬ 
search.  The  following  item  types  comprise  Form  F  of  the  Airman  Qualifying  Examination. 

Arithmetic  Reasoning.  Verbally  presented  problems  requiring  the  examinee  to  de¬ 
rive  his  own  method  of  solution  with  a  minimum  of  routine  arithmetic  computation . 

Verbal  Test.  A  relatively  pure  measure  of  academic  vocabulary. 

Mechanical  Principles.  Items  covering  the  actions  of  mechanisms  in  motion  and 
the  principles  pertaining  to  use  of  various  mechanical  devices. 

General  Mechanics.  Items  cast  in  verbal  form  as  a  measure  of  mechanical  informa¬ 
tion  and  experience. 

Tool  Functions.  Pictorial  items  of  various  tools  and  shop  equipment  oriented  to¬ 
ward  knowledge  of  the  appropriate  tool  and  its  proper  use  for  a  given  job. 

Hidden  Figures.  A  spatial  measure  requiring  the  discovery  of  one  of  several 
straight-line  figures  imbedded  in  a  more  complex  figure. 

Qerical  Matching.  Clerical  speed  and  accuracy  in  the  traditional  form  of  match- 
in  g  pairs  of  symbols. 

Numerical  Operations.  Arithmetic  computations  on  subtraction  and  division  as 
an  indicator  of  numerical  facility. 

Electrical  Information.  Elementary  fundamentals  of  practical  and  academic  infor¬ 
mation  on  electricity. 

Pattem  Comprehension.  A  flat  pattern  with  a  drawing  of  a  3'dimensional  object 
made  from  the  flat  pattern.  The  task  requires  identification  of  certain  sides  of  the  flat 
pattem  with  the  sides  of  the  3-dimensional  drawing. 

Technical  Data  Interpretation.  Extracting  relevant  data  from  charts  and  tables  for  use 
in  the  solution  of  simple  problems. 
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Table  4  shows  how  these  tests  ate  combined  to  derive  the  aptitude  indexes.  Of  possible 
interest  to  the  counselor,  the  four  composite  scores  of  the  Airman  Qualifying  Exa  mination 
c  ould  b  e  used  in  much  the  same  way  that  the  commercial  aptitude  test  battery  sc  ores  are  used. 
Th  e  four  aptitude  areas  of  the  AQE  are  job  oriented;  the  Airman  Classification  Manual  (AFM 
33-1)  and  the  USAF  Training  Prospectus  relate  training  courses  and  job  specialties  to  sug¬ 
gested  minimum  aptitude  levels.  Through  the  USAF  Occupational  Handbook,  major  job  areas 
in  the  Air  Force  are  related  to  the  civilian  technology  as  defined  in  the  Dictionary  of  Occupa¬ 
tional  Titles  (DOT).  There  is  then  a  way  to  go  from  Air  Force  jobs  and  the  AQE  scores  to 
the  civilian  job  structure. 

Although  individual  subtest  scores  are  not  presently  derived  in  the  scoring  of  the  Airnmn 
Qualifying  Examination,  it  is  possible  to  do  so.  Through  these  individual  scores  a  profile  of 
aptitude  factors  could  be  prepared  for  more  detailed  counseling  and  guidance  purposes  if  that 
were  desired.  The  point  is  that  the  individual  constituent  tests,  although  in  themselves  rather 
short  for  high  reliability,  could  be  used  in  much  the  same  manner  as  civilian  aptitude  test  bat¬ 
teries. 


TABLE  4.  Content  of  the  Airman  (Qualifying  Examination,  Form  F 


Subtest 

■H 

Scoring 

Formula 

M 

Aptitude  Index 
A  G 

E 

Clerical  KAttching 

50 

R-W 

X 

Numerical  Operations 

80 

R-W 

X 

Arithmetic  Reasoning 

15 

R 

X 

X 

X 

Verbal  Test 

29 

R 

X 

X 

Mechanical  Principles 

15 

R 

X 

'General  Mrchanics 

14 

R 

X 

Tool  Functions 

15 

R 

X 

Hidden  Figures 

16 

R 

X 

X 

Electrical  Information 

15 

R 

X 

Pattern  Comprehension 

16 

R 

X 

Technical  Data  Interpretation 

10 

R 

X 

The  chart  which  appears  on  the  following  pages  was  prepared  to  indicate,  by  AQE  apti¬ 
tude  areas  and  score  levels,  those  counterpart  jobs  in  the  civilian  technology  based  on  the 
Dictionary  of  Occupational  Titles. 

Relating  the  test  scores  to  jobs  with  this  chart  is  only  one  source  of  information  to  deter¬ 
mine  potential  aptitude.  Combining  the  aptitude  with  personal  interest,  suitability,  experience, 
and  other  data  provides  a  pattern  for  counseling  students  into  vocations  where  they  are  most 
likely  to  succeed.  It  is  important  to  remember  that  many  civilian  and  military  specialties  re- 
quire  some  degree  of  formal  training  before  the  individual  is  qualified  to  perform  in  his  field 
of  endeavor. 
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CHART  1.  AQE  APTITUDE  AREA  AND  LEVEL  RELATED  TO  DOT  JOB  LISTINGS* 

AF  Cteet  Field  Rdmted  Civiliao  Job«  AF  Careet  Fidd  Relted  GvIIIm  Job« 
ELECTRONICS  GENERAL  rCont.; 

Mialnun  Soon  ot  80  Mlatmom  Soon  of  60 


RADIO-RADAR 

SYSTEMS 

Communications  Engineet 
Electtooica  Engineet 

Radat  Equipment  Foteman 
Radio  Mechanic  D 

Radio  Repaitman 

ARMAMB4T 

SYSTEMS 

MAINT 

Radat  Maintenance 

Television  Maint 

Pteciaion  Inattu  Maint 

NUCLEAR 

WEAPONS 

Elect  Equip  Teatet 

Elect  Inattu  Rptmn 

TRAINDC 

DEVICES 

Insttuctot,  Link  Tnt 

Radio  Mechanic  II 

Insttument  Mao  IV 

MISSILE  ELEC¬ 
TRONIC  MAINT 

(Training  and  eiperieaee  re¬ 
ceived  in  the  Guided  Mieeile 
Syeteme  Career  Field  provide 
pereonnel  with  krtowledge  for 
certain  civilian  occupationt. 

.  The  degree  of  advancement 
and  proficiency  achieved  in 
a  particular  career  field  will 
determine  the  extent  to  which 
qualified  for  related  civilian 
field.) 

Minimum  Sooro  of  60 

INTRICATE  EQUIP 
MAINT 

Business  Mach  Insp 

Cameta  Rptmn 

Hoap  ft  Sutg  Equip  Svemn 

Stat  Mach  Svemo 

Tabulating  Equip  Mecb 

ACFT  ft  MSL 
ELECT  RPRMN 
DfSTRU 

RPFMN 

Electrician,  Aitplaoe 
Foteman,  Acft  Mfg 

Hydtaulic  Teatet 

Oxygen  System  Teste  t 

GENERAL 

Minimum  Score  of  80 

INTELUGENCE 

Dtaftsmao,  Topogtapbical 
Inveatigatot  VI 

Intetptetet 

Ttanalatot 

Coding  Cletk 

Radio-Message  Route  t 

Radio  Opetatot 

Cryptanalyst 

Ctyptographet 

Photo  Intetptetet 

WEATHER 

Meteorologist 

Weather  Forecaster 

Weather  Observer 

Aiipon  Control  Opt 
Inattu  Londiog  Tech 
Ait  Routs  Tttffie  Cootrollct 
Altetaft  Log  Cletk 

Repottet  (Ptint  &  Pub) 

Copy  Readet  (Print  Sc  Pub) 
Public  Relationa  II 
Hiatotian 

Editot,  Newa  (Ptiot  ft  Pub) 
Radio  Newa  Copyman 
Sctipt  Wtitet 
Neva  Analyat 
Continuity  Wtitet 

Teachet,  Gtade  ot  Gtammat 
School 

Regiattat,  Education 
Vocational  Ttaining  Teachet 
Film  Libtaty  Cletk 
Dtillmaatet 

Dental  Hygienist 
Dental  Mechanic 

Food  ft  Daity  Inapectot 
Labotatoty  Technician 
Nutae,  ludusttial 
Nutac,  Male 
Otthopedic  Tecboiciao 
Phatmaciat 
Physical  Thetapiat 
Physician’s  Assiataot 
Sanitaty  Inapectot 
Sutgical  Otdetly 
X-Ray  Tecboiciao  I 

Mlnlimun  Soon  of  40 

PHOTOGRAPHIC  Cametamen  (Motion  Pictute) 

Datk  Room  Man 
Fiim  Editot  (Motion  Pictute) 
Photogtaphet,  Aerial 
Phoiogtaphet,  Coounetcial 
Photogtaphet,  Potttait 
Photogtaphet,  Finishet 
Sound  Mixet 

FOOD  SERVICE  Beef  Cuttet  II 

Bench  Hand  II 
Chef  UI 
Cook,  Mess 
Cook,  Pastty 
Meat  Cuttet 
Oren  mao 
Pastty  Chef  II 
Pie  Xlaket 
Roundsman 
Stewatd  III 


AIR  TRAFFIC 
CONTROL  ft 
WARNING 


INFORMATION 

SVCS 


EDUCATION 
ft  TNG 


DENTAL 


MEDICAL 


*Ths  material  fot  this  chan  was  assembled  fot  use  by  high  achooi  guidance  oounaelota. 
The  chan  was  ptepatad  by  petsoancl  of  the  }907ib  Reciairiag  Graup,  USAF  Reciuitiag  Senrice, 
Lincoln  AFB,  Nebtaska,  aad  is  included  hate  with  iheit  petmiaaion. 
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CH^T  1.  (Continued) 


AF  Cfeet  Field  Related  Civilin  Jobs 
GENERAL  (Cont.) 

MlDtmBin  Score  of  40  (Conu) 


AF  Career  Field  Relted  Civilian  Jobs 
MECHANICAL  (Cont.) 

Mlnimnm  Score  oi  SIX  Cont. ) 


AIR  CREW  Guide,  Hunting  It  Fishing 

PROTECTION  Forest  Rsnger 

PRINTING  Compositor  I 

Dsrictoom  Men 
Linotype  Opetstot 
Linogrsphic  Pressmen 
Offset  Pressmen 
R/iotoengrever 
Photolithogrspher 
Photostst  Operstor 


Plumber,  Repsir 
Plumber 

Boilerhouse  Inspector 
Furnace  Tender 
Gas  Appliance  Svcmn 
Production  Controller 

LIQUID  FUEL  Manager,  Bulk  Plant 

SYSTEMS  Foreman  II,  Petro  Industry 

MAINT  Tester,  Petroleum 

Mlnimiim  Score  of  40 


AIR  POLICE 


PHOTCMAPPING 


Guard 

Guard,  Penitentiary 
Motorcycle  Patrolman 
Police  Inspector 
Police  Officer 
Supt  of  Police 
Watchman  I 
Detective 
Investigator 

Map  Draftsman 
Mapmsker 
Cartographer 
Compass  Man 


MECHANICAL 
Mlnlnmm  Score  of  60 


aCFT  8t  MISSILE 
ENSINE 
MECHANC 


MUNITIONS 

SPECIALIST 


MUNITIONS  & 
WEAPONS 
MAINT 


Aerial  Engineer 
Aircraft  Engine  Mech 
Aircraft  Mechanic 
Airplane  Inspector  I  &  II 
Engine  Tester 
Engineman  II 
Aeronautical  Engineer 

Foreman  (Explosives) 
Ammunition  Foreman 
Detonator  Assembler 
Munitions  Foreman 
Powderman,  Ammo 
Pyrotechnic  Mixer 

Aircraft  Armament  Mech 
Armament  Mechanic 
Armorer 

Gun  and  Turret  Worker 
Gunsmith 


MiBinmm  Score  of  SO 


GAS  GENERATING 
PLANT  OPER 

UTILITIES 


FIRE  PROTEC¬ 
TION 


WIRE  MAINT 


OFFICE  MACHNE 
REPAIRMAN 

ACFT  ft  MISSILE 
MAINT 


MOTORIZED  ft 
MISC  EQUIP 
MAINT 


METAL  WORKING 


Gas  Plant  Operator 
Substation  Operator 

Purification  Plant  Opr 
Foreman,  Water  works 
Sewer  and  Waterworks  Fore 
Water  Filterer 
Plumber,  Foreman 
Steamfitter  Foreman 
Air  Conditioning  Mech  II 
Electrician 


METALS  PROCES¬ 
SING  SPECIALIST 

PARACHUTE  AND 
FABRIC 


Fire  Chief 

Fire  Inspector  or  Marshal 
Fire  Extinguisher  Rprman 
Fire  Equipment  Man 
Fireman  III 

Cable  Splicer 
Central  Office  Repair 
Lineman,  Senior 
Telephone  Inspector 
Teletype  Repairman 
Manual  Equip  Rpr,  Central  .Off 

Office  Machine  Svcmn 
Statistical  Mach  Man 
Business  Mach  Insp 

Airplane  Mech 
Carburetor  Man 
Hydraulic  Tester 
Foreman  (Acft  Mfg) 

Automobile  Repairman 

Truck  Mechanic 

Tractor  Mechanic 

Motor  Analyst 

Maintenance  Mech  II 

Automobile  Accessories  Installer 

Automotive  Test  Engine  Mech 

Machinist 

Plater  I  • 

Sheet  Metal  Worker  Acft 
Sheet  Metal  Worker  III 
Toolmaker 
Welder,  Aceteleyne 
Welding  Specialist 

Boilermaker 
Blacksmith 
Welder,  Combination 

Parachute  Inspector 
Shroud  Web  Inspector 
Parachute  Repairman 
Parachute  Folder  or  Packer 
Foreman,  Leather  Mfg 
Tire  Inspector  II 
Tire  Classifier 
Fabric  Worker 
Doper  I,  Acft  Mfg 
Tire  Repairman  ft  Vulcanize  r 
Buffer,  Rubber  Tire  ft  Tube 


UTILITIES/Cont.; 


CHART  1.  (Continued) 


AF Career  Field  Related  Civilian  Jobs  AF  Career  Field  Related  Qvili an  jobs 


MECHANICALrCont.; 
Minimum  Score  of  40  (Cant.) 


AIR  FREIGHT 
SPEC 

Cargo  Handler 

MOTCR 

TRANSPORTA¬ 

TION 

Dispatcher,  Vehicle 
'  Shipping  Clerk 

Traffic  Rate  Clerk 

Trailer  Truck  Driver 

Ticket  Agent 

Greaser  or  Oiler 

Taxi  Driver  or  Qiauffeur 
Yardmaster 

Conductor,  Yard 

FUEL 

SPECIALIST 

Pumpman 

Oil  Pumper  or  Checker 

Tester,  Petroleum 

CONSTRUCTION 

Blaster  III 

Bricklayer  II 

Cabinet  Maker  I 

Carpenter,  House  I 

Cement  Finisher  II 

Painter,  Spray  I 

Power  Shovel  Operator 

ADMINISTRAnVE 

Minimum  Score  of  80 

ACCOUNTING  & 
FINANCE 

Auditor 

Accounting,  Cost 

Accounting,  General 
Bookkeeper  II 

Payroll  Clerk 

Accounting  Clerk 

Paymaster 

Bank  Cashier 

Manager,  Credit  8t  Collections 
Budg  et  Clerk 

Public  Accountant 

DATA  PROCES¬ 
SING  MACHINE 
OPERATOR 

Supervisor,  Machine  Records 
Key  Punch  Operator 

Sorting  Machine  Opt 

Verifier  Operator 

Tabulating  Machine  Opr 

STATISTICAL 

SVC 

Statistician 

Statistical  Clerk 

Statistical  Research  Asst 
Calculating  Machine  Opt 

Minimum  Score  of  60 

CHAPLAIN 

S\CS 

Chief  Clerk 

Clerical  Technician 

Organist 

Teacher,  Bible  School 

ADMINISTRATIVE  (ConL) 

Minimum  Score  of  60  (' Coni.) 

PROCUREMENT  Billing  Cleric 

Expediter 
Purchasing  Agent 
Procurement  Clerk 

RADIO  OPR  Radio  Operator,  Flight 

(AIR  tt  Radio  Operator,  App 

GROUND)  Radio  News  Copyman 

Radio  Operator 

NON-MORSE  Radio  Operator,  Flight 

OPR  Radio  Operator,  App 

Radio  Measage  Router 
Radio  Dispatcher 

Minimum  Sc  ore  of  40 

COMMUNICATIONS  Telephone  Supervisor 
OPERATION  Teletype  Operator 

Central  Office  Operator 

AIR  TRANS-  Steward,  Int’l  Airlines 

PORTATION  Foreman,  Air  Transportation 

Ticket  Agent 
Passenger  Agent 

SUPPLY  Inventory  Clerk 

Stock  Clerk 
Stock  Control  Clerk 
Manager,  District  Warehouse 
Stock  Parts  Inspector 
Shipping  Clerk 
Receiving  Clerk  II 
Marker 
Checker 

Manager  Retail  Food 
Commissary  Man 

ADMINISTRATIVE  Law  Clerk 

Claim  Adjuster 
Court  Clerk 
Tax  Collector 
Secretary 
Stenographer 
Stenotype  Operator 
Court  Reporter 
Mail  Soner 

Insured  &  Registered  Mail  Clerk 
Post  Office  Clerk 

SPECIAL  Manager,  Recreational  Estblmnt 

SERVICES  Group  Worker  (Community  Recrea¬ 

tion  Organizer) 

Director,  Playground 
Athletic  Coach 
Athletic  Trainer 
Instructor,  Physical 
Masseur 
Director,  Stage 
Actor 

Grounds  Keeper,  Sports 
Social  Welfare  Administrator 


IdSCMNEL  Receptionist 

Employment  Qerk 
Personnel  Clerk 
Vocational  Adviser 
Job  Analyst 
Employment  Interviewer 
Manager,  Bnployment 
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Some  Somative  Comparisons 

A  question  night  be  raised  about  the  meaning  of  the  Airman  Qualifying  Btaroination 
scores  from  the  normative  point  of  view.  Information  on  regional  differences  has  been  re¬ 
ported  (Gordon,  1953;  McReynolds  Ac  Nichols,  1933;  Thompson,  1938b)  and  some  compari¬ 
sons  with  Project  TALENT  norms  are  available  (Dailey  et  al.,  1962). 

First,  with  reference  to  geographical  area  differences,  three  separate  studies,  two  on 
the  Airman  Classification  Battery  Form  AC-IB  and  one  with  Form  AC-2A,  indicated  that 
trainees  from  Army  Areas  VI  (Far  West),  I  (Northeast),  and  V  (Middle  West)  were  generally 
superior  in  mean  test  score;  Army  Areas  III  (Southeast)  and  IV  (Southwest)  generally  had  some¬ 
what  lower  mean  scores  on  the  aptitude  tests  (see  Figure  1  for  location  of  Army  Areas).  The  far 
West  and  Middle  West  were  superior  to  other  regions  on  the  tests  of  mechanical  experience;  the 
Northeast  was  partic  ulatly  high  on  verbal  tests  and  on  the  highly  speeded  numerical  test. 


Fig,  I,  Anny  enlistment  areas  of  the  United  States. 


In  a  somewhat  different  normative  comparison,  the  United  States  Employment  Service 
General  Aptitude  Test  Battery  was  administered  to  a  group  of  basic  airmen  in  1938  and  the 
results  were  compared  with  a  similar  administration  in  1949  (McReynolds,  1939).  These  data, 
along  with  the  USES  normative  sample,  are  shown  in  Table  3,  and  they  give  some  indication 
o  f  the  relative  position  of  the  Air  Force  enlisted  personnel  inputs  for  those  time  periods  with 
reference  to  the  level  of  the  general  working  population  of  the  United  States.  On  the  separate 
tests  of  the  battery,  means  for  the  1938  group  of  basic  airmen  are  close  to  those  of  the  USES 
normative  sample  and  the  1949  groups  are  nearly  as  close.  One  area  where  the  airmen  are 
noticeably  lower  is  on  Test  8,  a  paper-and-pencil  test  of  Manual  Dexterity.  However,  none  of 
the  airman  classification  tests  attempt  to  measure  this  factor,  and  there  is  some  recent  re- 
s  earch  which  suggests  that  paper-and-pencil  tests  do  not  and  cannot  measure  adequately  a 
manual  or  finger  dexterity  ability  (Fleishman  &  Ellison,  1962). 
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TABLE  J.  Diatribudoa  Sttuistica  for  Aiimen  and  USES  Samplea 
on  the  Ganernl  ^dtude  Tent  Battery 


Fotm  B  •  IWl,  1949  Foim  B  •  100^  1958  CATB  ApUlade* 

Alniiea  USES  Saiaplc  Alimaa  USES  Sample  Aiimea 

GATB  Teat  (N  -  1096)  (N  •  4000)  (N  -  1640)  (N  -  4000)  (N  -  1096)  (N  -  3649) 


Namber 

M 

SD 

M 

SD 

M 

SD 

M 

SD 

M 

SD 

M 

SD 

!*> 

62.4 

15.7 

70.7 

22.1 

41.0 

11.3 

43.7 

16.0 

G 

106.7 

14.8 

102.3 

13.9 

2 

27.5 

5.7 

28.1 

8.1 

22.8 

4.6 

23.1 

6.7 

V 

95.1 

14.2 

95.9 

12.5 

3 

23.6 

6.2 

19.0 

7.0 

20.2 

5.3 

16.8 

6.5 

N 

104.1 

15.5 

99.7 

14.4 

4 

18.6 

6.6 

21.5 

9.4 

17.9 

6.2 

19.8 

10.0 

S 

116.2 

17.9 

110.3 

16.5 

5' 

22.5 

4.6 

21.8 

6.1 

28.1 

6.1 

29.1 

6.6 

P 

104.9 

15.6 

99.4 

17.7 

6 

9.8 

3.0 

9.9 

3.8 

11.7 

2.9 

11.4 

3.5 

Q 

91.4 

15.6 

96.5 

14.2 

7 

27.5 

6.9 

27.0 

8.1 

25.3 

5.8 

23.9 

7.0 

K 

88.4 

17.1 

93.0 

17.0 

8 

63.4 

9.0 

69.5 

10.3 

65.8 

8.8 

69.5 

10.3 

*  USES  Mean  it  100  tad  SD  it  20. 

^  The  fonntt  of  booklct-tntwer  theet  wot  chtaaed  betweea  Fonn  B*1001  tad  Foim  B-1002. 
^  Fofm  B*1002  hat  9  mote  iiemt  thta  Font  B-1001. 


In  a  aecond  nomatiTe  study  (Humphreya,  I960,  1962)  accomplished  through  extensive  coop¬ 
eration  with  the  Aviation  High  School,  New  Yorlc  City,  the  Airman  Classification  Battery  Form 
AG2A  was  administered  to  1600  students  in  the  school  at  midteim  of  the  1938-59  academic  year. 
The  following  year  at  approximately  the  same  point  in  time  the  same  battery  was  readministered. 
The  Aviation  High  School  offers  two  curricula:  a  pre-engineering  technical  curriculum  and  a 
terminal  aviation  mechanic  course.  A  major  purpose  of  the  experimental  testing  was  to  evaluate 
the  stability  of  the  Air  Force  tests  in  terms  of  average  performance  over  time  as  demonstrated 
by  resistance  to  special  training  or  test  practice  effects.  Table  6  presents  some  of  the  data  ob¬ 
tained  for  the  retest  group  and  three  control  groups  who  were  tested  only  once.  There  are  at  lea  st 
three  items  of  interest  in  the  mean  aptitude  indexes. 

One,  the  control  groups  tend  to  test  somewhat  lower  than  the  retest  group,  perhaps  because 
the  controls  contain  large  numbers  of  drop-outs  from  the  school.  (Control  groups  were  formed  ex 
post  facta  from  teat  data  available  on  students  who  appeared  for  only  one  adminiatration  of  the 
battery).  Two,  the  mean  growth  in  aptitude  indexes  is  somewhat  greater  for  the  controls  than  for 


TABLE  6.  Distribution  Statistics  on  Airman  Qassification 
Battery  for  High  School  Students 


Airman  Qassification  Battery  Aptitude  Indexes 

Aviation 

Mechanical 

Administrative 

General 

Electronics 

HS  Samples 

M 

SD 

M 

SD 

M 

SD 

M 

SD 

812  students  retested 
after  1-year  interval 
Test 

46.5 

19.3 

35.0 

17.7 

40.6 

18.0 

41.8 

18.1 

Retest 

63.1 

18.1 

41.5 

19.4 

52.8 

20.6 

53.0 

19.4 

Control  grotp  tested 

0  nee  only 

223  Sophomores 

37.0 

19.2 

30.3 

16.8 

32.3 

16.5 

32.1 

17.6 

210  Juniors 

48.1 

18.6 

35.8 

17.0 

38.4 

17.7 

39.9 

17.5 

322  Seniors 

60.6 

16.7 

37.9 

19.2 

46.3 

21.0 

51.9 

19.6 

the  rete  st  groins.  The  Mechanical  and  the  Electtontcs  indexes  in  particular  show  a  considerable 
effec  t  of  the  special  training.  Third,  these  groups  tend  to  score  below  the  mean  of  Ait  Force 
enlistees  entering  the  service  in  1958-39,  paiticularly  on  the  Administrative  ^titude  Index. 
Because  of  selective  factors  operating  with  respect  to  the  kinds  of  students  choosing  the  cur¬ 
ricula  of  this  high  school,  the  effects  on  aptitude  indexes  are  in  the  expected  direction. 

Still  another  set  of  data  comparing  Ait  Force  enlistees  with  civilian  populations  has  re¬ 
cently  been  obtained.  Table  7  shows  equivalents  on  the  AQE  percentile  scale  to  four  compos¬ 
ite  score  percentiles  derived  from  weighted  sets  of  tests  from  the  Project  TALENT  data.  These 
norms  show  how  a  group  of  Air  Force  enlistees  stand  on  certain  TALENT  tests  as  compared  with 
12th  grade  boys  and  18-year-old  boys  in  the  general  population.  Mote  detailed  information  on  the 
derivation  of  these  data  is  contained  in  a  separate  report  (Dailey  et  tU.,  1962). 


TABLE  7.  AQE  Scores  Related  to  TALENT  G>mpoattes 


TALENT  Composites 


AQE  Mechsnical  Administrative  General  Electronics 


Percentile 

12th  Gr 

18  Yr 

12th  Gr 

18  Yr 

12th  Gt 

18  Yr 

12tfa  Gt 

18  Yr 

95 

91 

94 

71 

79 

88 

92 

79 

85 

90 

84 

89 

60 

71 

80 

86 

76 

82 

85 

75 

83 

30 

62 

73 

82 

66 

73 

80 

69 

77 

44 

56 

67 

76 

58 

69 

75 

64 

73 

39 

52 

61 

71 

50 

61 

70 

59 

69 

29 

43 

49 

61 

44 

56 

65 

46 

57 

25 

38 

43 

55 

41 

53 

60 

37 

50 

20 

32 

36 

48 

34 

47 

55 

30 

42 

15 

26 

24 

37 

28 

40 

50 

27 

39 

12 

21 

19 

32 

23 

36 

45 

22 

34 

9 

17 

14 

26 

18 

30 

40 

18 

28 

5 

10 

12 

23 

14 

23 

35 

14 

24 

4 

8 

9 

19 

11 

21 

30 

12 

20 

3 

5 

4 

12 

9 

18 

25 

9 

15 

1 

3 

2 

7 

5 

12 

20 

4 

9 

-- 

2 

1 

3 

4 

11 

15 

1 

4 

-- 

1 

-- 

1 

1 

5 

10 

05 

-- 

2 

-- 

•- 

-- 

-- 

•• 

1 

01 

-- 

-- 

-- 

-- 

-- 

-- 

-- 

-- 

ApHtudt  Inputs  to  tbt  Air  Porce^ 

The  aptitude  level  of  basic  airmen  over  time,  particularly  since  the  USAF  Recruiting 
Service  has  in  recent  years  made  an  intensive  effort  to  obtain  the  maxiftium  quality  consistent 
with  the  numbers  to  be  enlisted,  shows  an  interesting  trend.  Since  1948  the  Air  Force  has 
used  a  program  of  aptitude  testing  for  enlisted  accessions  as  one  factor  in  making  job  and 
training  assignments  within  the  manpower  spaces  available.  In  the  13-year  period  through 
1961  there  have  been  two  basic  procedures  used  in  determining  which  applicants  would  be 
enlisted. 
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This  section  it  bated  on  an  earlier  report  by  Leczntr  (1962). 
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Initially,  with  the  implementation  of  the  Depanment  of  Defense  Amed  Forces  Qualifi¬ 
cation  Test,  applicants  for  Air  Force  enlistment  were  screened  first  on  the  Enlistment  Screen¬ 
ing  Test  at  the  recruiting  level  followed  by  administration  of  the  AFQT  at  Recruiting  Main 
Stations  or,  later,  in  what  was  called  an  Armed  Forces  Ezaming  Station.  Assuming  the  ap¬ 
plicant  then  met  the  physical  requirements,  he  was  enlisted.  Aptitude  testing  for  classifica- 
tion  and  assignment  purposes  was  part  of  the  program  during  basic  military  training.  Within 
this  general  set  of  procedures,  details  varied  from  time  to  time  based  on  the  needs  of  the 
s  eryices.  For  example,  AFQT  minimum  cutting  scores  were  varied  and  there  has  been  a 
qualitative  distribution  of  manpower  across  the  services  based  on  AFQT  scores. 

Beginning  in  April  1938  the  Air  Force  instituted  a  program  of  selective  enlistment.  Ap¬ 
plicants  who  had  qualified  on  the  AFQT  were  next  required  to  meet  certain  minimum  require¬ 
ments  on  the  Airman  Qualifying  Examination  (AQE).  In  effect,  as  the  program  evolved,  the 
applicant  was  selected  and  actually  classified  before  he  was  accepted  for  enlistment.  In  a 
subsequent  variation,  administration  of  AQE  became  the  first  hurdle  imposed  on  an  applicant; 
subject  to  qualification  for  at  least  one  of  several  job-aptitude  quota  groups,  the  individual 
then  had  to  meet  the  minimum  AFQT  score  and  be  physically  qualified  in  order  to  be  enlisted. 
Again  there  have  been  variations  in  the  details  of  the  selective  enlistment  program  from  time 
to  time  such  as  changes  in  AQE  aptitude  minimums,  use  of  educational  requirements  as  second¬ 
ary  screens,  and  varying  administrative  procedures,  all  intended  to  maximize  quality  within 
manpower  procurement  objectives. 

In  the  Air  Force,  assessment  of  aptitudes  during  this  period  has  been  accomplished 
through  two  instruments,  the  Airman  Classification  Battery  AC-2A  and  the  Airman  Qualifying 
Examination.  The  AC-2A  was  administered  at  the  basic  military  training  center  from  January 
1936  through  August  1939,  but  the  aptitude  scores  were  used  for  classification  and  assign¬ 
ment  purposes  only  from  January  1936  until  April  1938.  The  Airman  Qualifying  Examination 
Form  0  became  a  selective  recruiting  instrument  in  the  hands  of  the  USAF  Recruiting  Service 
on  1  April  1938  and  was  used  until  1  November  I960  when  AQE  Form  F  became  the  enlistment 
aptitude  qualification  test,  followed  by  AQE  Form  62  on  1  October  1962.  The  AC-2A  had  been 
standardized  and  normed  to  the  World  War  II  mobilization  population  with  the  AFQT  as  a  com¬ 
mon  base.  AQE  was  normed  on  an  equipercentile  procedure  to  the  AC-2A,  and  Forms  D  and  F 
o  f  AQE  were  standardized  so  as  to  be  equivalent  forms. 

Figure  2  shows  the  mean  General  Aptitude  Index  by  month  for  the  years  1936  through 
1961,  except  I960  for  which  means  have  not  been  summarized.  The  values  shown  are  for  male 
non-prior- service  enlistees.  There  are  several  points  of  interest  in  this  chart. 

There  has  been  a  progressive  increase  in  the  quality  of  Air  Force  enlisted  accessions  as 
measured  by  this  aptitude  index.  Because  of  the  many  factors  which  might  cause  such  an  in- 
c  rease,  it  is  difficult  to  ascribe  the  change  in  aptitude  level  to  any  particular  event.  There 
have  been  some  procedural  policies  that  impact  here;  for  example,  the  selective  recruiting 
program  has  tended  to  defer  enlistment  of  applicants  who  did  not  achieve  the  40th  percentile 
on  at  least  one  of  the  four  aptitude  indexes  in  the  Airman  Qualifying  Examination.  But  at  the 
same  time,  it  might  be  suggested  that  Sputnik  in  October  1937  caused  a  general  upgrading  of 
the  quality  of  education;  or  perhtqjs  more  general  use  of  aptitude  tests  with  emphasis  on 
counseling  and  guidance  may  be  a  contributing  factor  to  the  upward  trend. 

The  relatively  low  quality  of  the  input  in  1936,  where  the  mean  General  Aptitude  Index 
ranged  from  a  low  of  33  to  a  high  of  only  43  (the  theoretical  mean  of  the  World  War  II  mobiliza¬ 
tion  population  was  47.3),  can  probably  best  be  accounted  for  in  the  Department  of  Defense 
directive  on  allocation  of  manpower.  In  that  year,  the  Air  Force  enlisted  considerably  greater 
numbers  of  airmen  in  the  Category  IV  level  on  the  Armed  Forces  Qualification  Test  in  propor¬ 
tion  to  the  total  input;  this  was  done  to  even  out  the  percentage  of  Category  IV  personnel 
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across  the  services.  It  has  previously  been  pointed  out  that  quality  of  Air  Force  inputs  varies  as 
a  function  of  the  screening  and  allocation  policies.  The  mean  aptitude  level  of  the  1956  group 
tends  to  confirm  these  findings. 

Changes  in  mean  AI  by  month  of  the  year  follow  a  rather  consistent  pattern  over  the  years. 
April  and  May  represent  the  low  point  in  aptitude  level,  with  June,  July,  August,  and  September 
s  howing  a  gradual  increase  to  a  high,  followed  by  a  gradual  decrease  in  October,  November, 
and  December,  and  a  leveling  off  in  January,  February,  and  March.  This  trend  probably  reflects 
school  schedules  and  the  traditional  summer  months  when  schools  close.  As  September  ap¬ 
proaches,  the  high  school  graduate  who  has  no  plans  for  college  reaches  the  decision  to  dis¬ 
charge  his  military  obligation  by  voluntary  enlistment. 

There  are  variations  that  appear  within  the  monthly  cycles  and  some  of  these  points  can 
be  associated  with  known  events.  One  of  these,  April  1958,  marked  the  start  of  the  selective- 
pre-enlistment  program  with  specific  monthly  quotas,  by  aptitude  levels,  to  be  filled;  there  was 
an  associated  establishment  of  the  40th  percentile  on  at  least  one  aptitude  index  as  a  require¬ 
ment  for  eligibility  over  and  above  qualifying  on  AFQT  at  the  21st  percentile.  The  continua¬ 
tion  of  high  quality  in  October,  November,  and  even  De-^ember  1961  was  probably  a  function  of 
two  factors— the  Berlin  crisis  which  led  to  call-up  of  reserves  and  increased  draft  quotas  as  an 
external  event,  and  implementation  of  a  procedure  within  the  Recruiting  Service  to  "take  off 
the  top"  of  the  available  applicants  to  meet  monthly  objectives  rather  than  selecting  on  a  "mine 
run"  basis.  There  is  no  readily  apparent  event  that  might  be  associated  with  the  steep  rise  in 
mean  General  AI  in  August  1959.  The  data  in  Table  8  on  the  number  of  high  school  graduates 
among  Air  Force  enlistees  show  some  interesting  trends.  First,  the  percentage  of  high  school 
graduates  in  the  input  by  month  and  year  of  enlistment  follows  very  closely  the  pattern  in  Fig¬ 
ure  2.  From  a  moderate  level  in  January  and  February,  there  is  a  decrease  in  March  to  a  low 
in  April  and  May.  June  shows  a  tremendous  rise  to  a  high  point;  July  and  August  drop  some- 
wh  at,  with  a  slight  upswing  in  September.  There  follows  a  progressive  decrease  through 
October,  November,  and  December.  This  is,  of  course,  what  would  be  expected  to  happen  to 
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the  mean  General  ^itude  Index;  ita  trend  should  be  consistent  with  that  of  the  percentage  of 
high  school  graduates  in  the  enlistment  group. 

Of  somewhat  greater  importance  is  the  trend  in  percentage  of  high  school  graduates  in  the 
input  over  the  years.  In  1931  to  1953,  this  value  was  around  53  percent;  in  1954  it  dropped  to 
30  percent  and  has  shown  a  general  rise  since.*  In  1958,  the  year  when  selective  recruiting 
started,  72  percent  of  the  enlistees  were  high  school  graduates;  in  1961,  this  rate  was  up  to  77 
percent,  and  for  1962  it  climbed  to  83  percent.  The  trend  probably  has  its  basis  in  two  factors. 
First,  the  impact  of  selective  recruiting  which  attempts  to  maximize  quality  consistent  with 
mai^wer  objectives;  and  second,  efforts  on  the  part  of  the  USAF  Recruiting  Service  to  encour¬ 
age  completion  of  high  school  before  enlistment.  The  latter  procedure  stems,  in  part,  from  data 
which  suggest  that  the  high  school  graduate  is  less  likely  to  be  released  from  the  service  for 
reason  of  unsuitability  (Flyer,  1959). 


TABLE  8,  Percentage  of  High  School  Graduates  in  Air  Force  Enlistments 
(Data  limited  to  non-prior-tervice  maleg  at  Lackland  AFB) 


Year 

Jan 

Feb 

Mar 

Apr 

May 

Jun 

Jul 

Aug 

Sep 

Oct 

Nov 

Dec 

Total 

1952  Input 

1)708 

12274 

8303 

5270 

4576 

6775 

7184 

7503 

5242 

4024 

2959 

3229 

81047 

%  HSG 

57.3 

58.8 

56.3 

50.6 

41.6 

60.1 

52.3 

46.8 

53.6 

50.7 

49.2 

44.9 

53.6 

1953  Input 

3702 

6156 

5984 

4266 

1686 

851 

1917 

1835 

1605 

3111 

4062 

4747 

39922 

%  HSG 

54.0 

56.1 

56.9 

53.2 

51.6 

64.0 

59.7 

62.0 

61.2 

54.4 

46.6 

37.9 

53.1 

1954  Input 

7755 

4908 

5462 

7788 

8596 

8160 

7531 

9289 

4641 

3627 

67757 

%  HSG 

— 

38.4 

38.1 

44.4 

70.7 

62.1 

50.8 

47.0 

50.8 

43.4 

37.2 

50.0 

1955  Input 

7521 

8988 

4082 

6284 

387) 

6375 

4904 

4420 

4806 

4360 

4339 

2355 

62307 

%  HSG 

51.0 

48.5 

35.8 

22.7 

31.3 

64.6 

75.6 

79.0 

71.2 

65.4 

54.1 

46.3 

53.5 

1956  Input 

-  - 

7)05 

5252 

4212 

-  • 

9360 

7447 

8913 

12945 

9570 

8267 

5094 

78365 

%HSG 

-  - 

57.6 

35.2 

31.3 

— 

76.0 

66.8 

60.7 

63.4 

57.9 

52.9 

47.4 

57.9 

1957  Input 

10938 

7749 

7248 

-  - 

6223 

8266 

7720 

7759 

.  - 

5064 

.  . 

•  . 

60967 

%  HSG 

52.0 

54.7 

50.6 

-  - 

49.9 

77.9 

79.1 

74.9 

71.7 

63.5 

1958  Input 

4192 

5966 

3441 

3102 

3538 

5079 

6602 

6614 

6095 

6037 

5594 

3087 

59347 

%  HSG 

60.4 

61.5 

61.8 

67.4 

61.8 

74.3 

80.4 

79.8 

80.6 

76.3 

73.3 

66.9 

71.9 

1959  Input 

5425 

5157 

5271 

2082 

3912 

6159 

7226 

7423 

7327 

7069 

7031 

4501 

68583 

%HSG 

65.5 

68.2 

66.6 

49.5 

66.0 

79.2 

80.5 

80.2 

80.5 

76.3 

66.0 

62.6 

72.3 

1960  Input 

6940 

7323 

6603 

4703 

5404 

11666 

9518 

11444 

12625 

9417 

7630 

5174 

98447 

%HSG 

66.5 

61.4 

56.8 

50.6 

63.2 

82.9 

82.2 

76.0 

76.6 

70.1 

66.8 

60.2 

70.4 

1961  Input 

11720 

8742 

9467 

6903 

7317 

10751 

11054 

11276 

10474 

9618 

8977 

5264 

111563 

%  HSG 

66.4 

66.0 

60.6 

59.1 

64.1 

84.8 

86.8 

85.3 

87.6 

86.5 

82.0 

97.9 

77.4 

1962  Input 

10314 

9207 

8114 

7902 

6135 

11145 

8158 

10789 

10984 

8707 

6450 

4242 

102147 

%  HSG 

93.4 

93.2 

72.9 

68.5 

75.8 

88.4 

87.0 

84.4 

85.2 

81.8 

75.5 

71.5 

82.8 

SECTIOS  3.  SOME  TECHNICAL  ASPECTS  OF  AIR  FORCE  CLASSIFICATION  TESTS 

Prior  to  1947,  assignment  of  enlisted  personnel  in  the  services  was  based  almost  solely 
upon  the  single  score  achieved  from  the  Army  General  Classification  Test  (AGCT).  Classifica¬ 
tion  based  on  a  single  general  score  such  as  AGCT  is  as  wasteful  as  the  use  of  a  general  pur¬ 
pose  fertilizer  on  all  types  of  soil  without  regard  for  an  analysis  of  the  nutritional  elements 
availid>le  in  each  type.  For  any  given  soil  type,  many  of  the  minerals  in  the  fertilizer  are 
wasted  because  they  may  already  be  available  in  sufficient  quantity.  Similarly,  when  personnel 
are  se  lected  for  a  specific  training  course  because  of  high  AGCT  score  (high  average  score  on 
several  different  abilities),  their  high  abilities  on  factors  not  particularly  relevant  to  that  course 
are  wasted. 
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For  example,  assume  a  certain  course  has  a  minimum  AGCT  score  of  110  for  entrance, 
and  that  30  percent  of  Air  Force  enlistees  are  qualified  by  AGCT  score  to  entet'the  course. 

Since  a  specific  aptitude  index  validated  for  that  course  would  probably  not  be  highly  correlated  • 
with  AjCT,  some  enlistees  below  AGCT  110  would  qualify  on  the  specific  index  and  some  above 
AGCT  110  would  not  qualify.  Thus  the  individuals  below  AGCT  110  best  qualified  on  the  index 
could  be  substituted  for  those  qualified  on  AGCT,  but  not  on  the  index,  with  no  reduction  in  the 
over  all  quality  of  students.  As  a  consequence,  use  of  specific  indexes  instead  of  a  single 
general  score  results  in  economy  of  talented  personnel.  Low  abilities  on  one  index  are  compen¬ 
sate  d  for  by  high  abilities  on  another  index,  but  on  a  general  score  these  differences  are  not 
readily  apparent  or  usable. 

The  Way  Tests  Are  Vfed^ 

A  basic  reason  tot  using  tests  to  select  men  for  training  lies  in  the  fact  that  it  costs  less 
to  test  a  man  than  it  does  to  attempt  to  train  him  and  discover  that  he  is  untrainable.  A  testing 
program  becomes  more  valuable  as  the  pool  of  men  from  which  trainees  are  to  be  selected  be¬ 
comes  larger,  so  that  smaller  portions  of  the  pool  can  be  taken  for  training.  The  proportion  of 
men  selected  from  the  pool  is  called  the  "selection  ratio,”  as  shown  in  Figure  3. 


APTITUDE  INDEX 


Fig,  3,  Selectioa  ratio.  U  the  aptitude  minimum  is  set  at  60,  7  men 
ate  selected  from  the  10  available;  the  selection  ratio  is  .7.  If  the  aptitude 
minimum  were  set  at  70,  the  selection  ratio  would  be  .S. 


^This  section  is  based  on  material  from  Btokaw  St  Holdreie  (1960). 
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As  the  selection  rstio  becomes  more  fsvorsble  the  use  of  s  vslid  test  reduces  the  cost 
o  f  training  in  terms  of  cost  per  graduate.  The  operation  of  this  factor  can  be  observed  in  Fig¬ 
ure  4.  If  measures  of  airman  productivity,  for  example  grades  from  technical  school,  are  plotted 
o  n  a  chart  against  the  latitude  indexes  achieved  if  unselected  airmen  are  sent  to  that  school, 
it  will  be  found  that  they  fall  in  an  oval  area  like  that  in  the  figure.  If  a  certain  technical 
school  grade,  shown  by  the  broken  horizontal  line  in  the  figure,  is  established  as  the  passing 
mark,  the  area  below  the  line  indicates  the  proportion  of  examinees  who  will  fail  in  the  school. 

Establishment  of  an  latitude  minimum,  say  at  60  as  shown  by  the  vertical  line  in  the  fig- 
u  re,  below  which  airmen  are  not  admitted  to  training,  eliminates  numb  ers  of  trainees  who 
would  fail  in  the  school,  and  therby  saves  training  costs  for  them.  Raising  the  aptitude  mini¬ 
mum,  as  shown  in  Figure  3  by  the  parallel  broken  lines  added  to  the  right  of  the  aptitude  mini¬ 
mum  alters  the  selection  ratio  so  that  the  number  of  eliminees  per  graduate  is  reduced,  and  the 
cost  of  training  is  lowered  still  more. 

TECHNICAL 
SCHOOL  I 
GRADE 


100  \- 


90  U 


70  k- 


1  •  .  *  • 


PASS 


80  ^ - 


•  •  •  I*  • 

•  •••••  .1. 

•  *  *  •  *  I*  • 


UNQUALIFIED  | 


QUALIFIED 

1  J _ L 


30  40 


50  60  70 

Aptitude  Index 


90 


Pig.  4>  Relationship  of  technical  school  grade  to  aptitude  index. 
The  fisure  shows  the  pattern  of  gtsdes  and  aptitude  indexes  expected  in  a  rela¬ 
tively  unselected  sample.  The  lines  show  the  relationship  between  a  recom¬ 
mended  aptitude  index  and  the  passing  mark  in  the  school.  The  dots  io  area 
"a”  represent  airmen  who  are  qualified  on  the  aptitude  index  who  would  past 
in  school.  Area  "b”  teptetents  airmen  who  would  not  be  admitted  to  training, 
but  who  would  graduate  if  admitted.  Area  "c"  includes  men  who  would  fail  in 
training,  who  are  barred  from  training  by  the  aptitude  minimum.  Area  "d”  con¬ 
tains  men  who  ate  admitted,  bat  who  fail  in  school.  Note  that  the  position  of  the 
aptitude  minimum  bests  directly  on  the  proportion  of  men  admitted  to  school  who 
pass;  insofar  as  this  represents  a  gain  in  the  rate  over  the  rate  expected  for  an 
unselected  population,  economies  ate  effected. 
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It  is  apparent  that  a  number  of  airmen  who  would  "pass”  the  school,  are  eliminated  by 
the  recommended  aptitude  minimum.  These  potential  graduates  can  be  obtained  for  training 
b  y  lowering  the  aptitude  minimum,  but  at  a  higher  cost  per  graduate  due  to  the  increasing 
costs  of  the  partial  training  received  by  eliminees. 


TECHNICAL 
SCHOOL 
GRADE 


Fig,  3,  Effect  of  raising  minimum  aptitude  index  on  selection 
ratio  and  on  failure  rate.  Note  that  raising  the  recommended  minimum  to 
the  80  level  reduces  the  failure  rate  to  0,  but  also  establishes  a  severe  selec 
lion  ratio. 


If  the  pool  of  potential  trainees  is  sufficiently  large  to  permit  placement  of  a  severely 
high  aptitude  minimum,  insuring  a  greater  certainty  of  graduation  for  each  man  entering  train¬ 
ing,  the  number  of  men  entered  into  training  can  be  reduced  closer  to  the  number  of  men  actu¬ 
ally  needed  in  Air  Force  jobs,  and  a  maximum  economy  in  training  is  realized. 

Further  inspection  of  Figures  4  and  3  will  reveal  that  there  is  no  information  upon  which 
an  objective  aptitude  minimum  can  be  established-there  is  no  realistic  level  of  aptitude  above 
which  all  men  "pass”  and  below  which  all  men  "fail.”  This  could  be  true  only  with  a  school 
grade  of  perfect  reliability  and  a  test  of  perfect  validity. 

The  establishment  of  a  minimum  must  balance  the  size  of  the  potential  trainee  pool 
against  the  number  of  men  who  must  be  trained.  As  the  selection  ratio  is  improved,  and  as 
the  validity  of  the  test  is  raised,  economies  in  training  will  result. 
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This  discussion  sssumes  graduation  of  a  trainee  capable  of  meeting  certain  standards  of 
competence.  It  is  apparent  that  a  decrease  in  the  ability  of  trainees  would  require  adjustments 
in  training  procedures  to  prevent  an  increased  failure  rate.  These  adjustments  might  take  the 
form  of  maintaining  the  proportion  of  graduates  by  lengthening  the  training  period,  or  by  having 
larger  numbers  of  students  repeat  the  course. 

These  devices  for  maintaining  the  flow  through  a  school  in  the  face  of  a  reduced  capa¬ 
bility  on  the  part  of  trainees  carry  with  them  an  increase  in  training  costs.  These  costs  can  be 
d  irect,  in  the  form  of  dollars  for  students  who  are  trained  for  an  increased  length  of  time;  and 
indirect,  if  graduates  must  be  accepted  who  are  less  competent  to  assume  the  duties  of  Air 
Force  jobs. 

Scaling  umd  Norms 

As  with  any  test  or  battery  that  is  used  to  compare  individuals,  test  scores  need  to  be 
stated  in  some  standard  form.  The  early  Air  Force  classification  tests  used  a  standard  9-point 
scale,  called  "stanines,"  developed  during  Vorld  War  II.  Both  the  subtest  scores  and  the 
composites  were  expressed  in  this  form.  Beginning  with  Form  AC-2A  of  the  Airman  Classifi- 
c  ation  Battery  and  Form  D  of  the  Airman  Qualifying  Examination,  the  composite  scores  or 
aptitude  indexes  have  been  expressed  in  terms  of  a  modified  percentile  scale.  This  metric 
u  ses  only  20  points:  01,05,  10,  15  .  .  .  85,90,95. 

Forms  D  and  F  of  the  Airman  Qualifying  Examination  were  normed  by  the  equipercentile 
method  to  the  Airman  Classification  Battery  AC-2A.  The  standardization  samples  tested  on 
AQE  during  its  development  process  had  previously  taken  AC-2A.  Since  the  four  composite 
scores  of  AQE  had  counteiparts  in  AC-2A  it  was  possible  to  make  each  of  these  distributions 
the  same  in  shiqse  and  dispersion  as  the  distributions  of  the  composite  scores  in  AC-2A  for  the 
sanple  tested.  Thus  AQE  aptitude  indexes  could  be  treated  as  having  the  same  meaning  as 
the  AC-2A  indexes. 

In  turn,  the  AC-2A  had  been  scaled  to  the  World  War  11  mobilization  population  through 
the  use  of  the  Army  General  Classification  Test  as  a  reference  variable.  Through  a  series  of 
steps  involving  correlation  of  the  AC-2A  subtests  with  the  AFQT  and  adjusting  for  truncation 
caused  by  selection  on  AFQT,  the  standardization  sample  for  AC-2A  was  equated  to  the  war¬ 
time  population.  As  a  result,  AC-2A  and  AQE  aptitude  indexes  have  a  common  meaning  as  well 
a  s  relationship  to  a  "known”  wartime  population  within  fairly  narrow  error  limits. 

With  the  passage  of  time,  there  is  increasing  concern  that  the  youth  of  the  1960's  are  dif¬ 
ferent  than  the  World  War  II  mobilization  population.  Just  as  the  base  year  for  the  cost  of  living 
index  is  changed  periodically,  it  may  be  that  the  base  groiq>  for  norming  of  airman  selection  and 
classification  tests  needs  to  be  revised.  To  that  end,  some  of  the  data  repotted  earlier  on  norms 
for  Air- Force  personnel  with  respect  to  Project  TALENT  test  composites  will  be  considered  for 
use  as  a  new  reference  point  for  standardization  of  future  Air  Force  tests. 

RtUability  and  Validity 

Specific  values  for  the  reliability  ^nd  validity  of  the  several  composite  scores  have  been 
computed  at  various  times  by  standard  statistical  formulas.  For  the  Airman  Classification  Bat¬ 
tery  Form  AC-2A,  reliability  estimates  are  available  for  both  the  subtests  and  the  composites 
or  aptitude  indexes  (Btokaw  &  Burgess,  1957).  These  are  presented  in  Table  9.  The 
reliabilities  for  the  aptitude  indexes  of  the  Airman  Qualifying  Examination,  Forms  D,  E,  and  F 
are  contained  in  Table  10.  The  values  compare  favorably  with  those  reported  for  commercial 
aptitude  test  batteries.  Individual  test  reliabilities  for  AQE  have  not  been  estimated,  since 
subtest  scores  are  not  used  separately  for  any  purpose. 
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TABLE  9,  Reliability  Eatimatea  for  Teat  Vatiabiea 
of  Aitman  Qaaaificadon  Battety  AC-2A* 


(SempleM:  Vaiiout  lumbert  of  batie  aimen) 


Variable 

Type  of  Reliability  Eathnate 

St>li^Half°  Teat-Retest 

'll  'li  'tt 

(N-2202)  (N-500)  (N-277) 

Alternate  Form 

'tt 

(N<^2202) 

Aptitude  Index 

Mechanical 

.91 

Adffliniatrative 

.89 

Rad  io  Operator 

.87 

General 

.87 

Electronics 

.93 

Biographical  Inventory 

Mechanical  Key 

.76 

Administrative  Key 

.83 

Electronics  Key 

.70 

Arithmetic  Reasoning 

.75 

.86 

.75 

Verbal  Test 

.85 

.92 

.81 

Mechanical  Test 

.77 

.87 

Tool  Functions 

• 

.74 

Figure  Recognition 

.71 

.83 

Clerical  Matching 

.87 

Numerical  Operations 

.80 

Technical  Information 

.76 

.87 

I^ttem  Analysis 

.78 

.88 

Air  Force  Aural  Code  I 

.81 

.90 

Air  Force  Aval  Code  II 

.92 

.96 

.74 

*Ftom  Tables  ?  and  6,  Brokaw  at  Burgess  (19S7)- 

^Eicimated  by  a  correUtioa  of  sums  formula  (Jackaon  &  Ferguaoiig  1941)* 

^  Corrected  by  Spearman-Brown  prophecy  formula  for  full  teat  length. 

TABLE  10. 

Reliability  Estimates  for  Aptitude  Indexes 

of  Ainnan  Qualifying  Examination 

(Samples:  Various  numbers  of  basic  airmen) 

Cortelation  of 

Correlation  of 

Fonn  F 

Aptitude 

Fotin  D  with  AC-  2A 

Form  E  with  AC-2A 

Test-  Retest 

Index  Size  of  Sample; 

1177  320  1083  506 

2428  320  371 

681 

Mechanical 

.80  .81  .81  .83 

.79  .80  .82 

.83 

Administrative 

.76  .74  .78  .75 

.74  .74  .80 

.88 

General 

.81  .82  .81  .80 

..78  .82  .84 

.81 

Electronic 

.83  .85  .83  .84 

.82  .85  .83 

.82 

21 


a 


The  validity  of  the  Air  Force  classification  batteries  is  continually  being  determined 
by  follow-up  of  students  through  technical  training  courses.  The  Airman  Classification  Bat¬ 
tery  in  its  first  form,  AC-IA,  was  recommended  for  use  only  after  its  predictive  efficiency  had 
been  determined.  Forms  AC- IB  and  AC-2A  of  this  battery  were  also  checked  against  criteria 
of  technical  school  grades  across  a  wide  variety  of  specialties  with  quite  satisfactory  results. 
Summaries  of  these  data  are  listed  in  the  references  (Brokaw,  19S9a,  1939b,  1939c;  Gragg  & 
Gordon,  1931;  Thompson,  1938c).  For  the  Airman  Qualifying  Examination,  extensive  validity 
data  have  been  gathered  for  the  Form  F  aptitude  indexes  on  a  number  of  technical  training 
courses.  The  coefficients  in  Tables  11  through  14  are  based  on  male  airmen  graduating  from 
technical  schools  during  the  calendar  year  1961.  Both  the  raw  coefficient  and  the  one  cor¬ 
rected  for  the  restriction  in  range  are  at  acceptably  high  values.  The  restriction  resulted  from 
selection  for  entry  to  the  course  at  a  specified  minimum  aptitude  level  (note  the  obtained  stand¬ 
ard  deviation  for  the  aptitude  index  as  compared  with  the  theoretical  standard  deviation  of  28.8 
for  the  percentile  scale  and  one  of  approximately  23.00  obtained  fur  all  examinees  tested  in 
1961).  As  a  matter  of  fact,  the  efficiency  with  which  each  index  predicts  the  training  success 
in  those  schools  for  which  it  was  designated  as  the  selector  index  is  at  generally  acceptable 
level. 


TABLE  11.  Validity  of  AQE-F  Mechanical  A1  for  Mechanical  Training  Courses 


Course  Number  and  Title 

N 

Mechanical  AI 

Mean  SD 

Final 

School  Grade 

Mean  SD 

Validity 

42132-1 

Acft  &  Missile  Pneudraulic  Rptmn 

202 

73.4 

11.2 

85.3 

2.8 

.42 

.68 

42231 

Mechanical  Access  &  Eqpmt  Rprron 

164 

71.7 

11.1 

85.3 

2.7 

.40 

.67 

43131A 

Acft  Mechanic,  Recip  Eng  Aircraft 

770 

59.3 

13.7 

85.8 

2.9 

.47 

.66 

43230-1 

Jet  Engine  Mechanic 

350 

62.4 

13.7 

85.3 

2.9 

.47 

.66 

43231 

Reciprocating  Engine  Mechanic 

502 

60.9 

13.4 

85.6 

2.9 

.40 

.60 

43330-3 

Missile  Mechanic 

125 

89.4 

8.2 

86.7 

2.5 

.31 

.68 

46230 

Weapons  Mechanic 

253 

82.2 

7.9 

87.6 

3.0 

.32 

.70 

47131 

Automotive  Repairman 

233 

73.3 

10.3 

85.2 

2.4 

.31 

.58 

33430 

Airframe  Repairman 

198 

68.7 

10.9 

86.9 

2.6 

.28 

.53 

34330 

Electrical  Power  Production  Sped 

539 

61.6 

9.0 

85.9 

2.5 

.39 

.73 

37130 

Fire  I^otection  Specialist 

617 

58.6 

9.4 

86.4 

2.6 

.28 

.58 
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TABLE  12.  Validity  of  AQlt>F  AdminisBative  AI 
for  Adminiatradve  Training  Courses 


Course  Number  and  Title 

N 

Adninis- 
tradve  AI 
Mean  SD 

Final 

School  Grade 

Mean  SD 

Validity 

*  c* 

29130 

Communication  Center  Specialist 

740 

67.9 

13.1 

85.5 

2.6 

.45 

.66 

64530 

Inventory  Management  ^ecl 

1041 

60.0 

13.3 

85.8 

3.4 

.30 

.48 

6  4630 

Organizational  Supply  Sped 

1307 

59.3 

13.2 

86.8 

3.7 

.50 

.71 

64730 

Warehousing  Specialist 

433 

59.5 

13.3 

86.9 

3.2 

.34 

.53 

67130 

A:ctng  &  Finance  Sped 

419 

88.5 

5.9 

86.5 

3.1 

.20 

.63 

6 85 30 A  Data  Processing  Machine  Opr 

443 

90.2 

5.6 

86.1 

3.1 

.08 

.33 

70230 

Administrative  Specialist 

1350 

64.6 

13.2 

85.4 

3.2 

.28 

.46 

73230 

Personnel  Specialist 

• 

622 

79.4 

8.5 

86.0 

3.1 

.28 

.63 

TABLE  13.  Validity  of  AQE-F  General  AI 
for  General  Training  Courses 

Course  Number  and  Title 

N 

General  AI 

Mean  SD 

Final 

School  Grade 

Mean  SD 

Validity 

r  r 

c 

25231 

Weather  Observer 

214 

88.9 

5.6 

85.4 

2.5 

.34 

.83 

27 330 A 

Acft  Control  St  Warning  Opr  (Manual) 

282 

67.3 

5.6 

86.3 

2.6 

.30 

.80 

27330B 

Acft  Control  St  Warning  Opr  (SAGE) 

467 

66.5 

5.8 

85.9 

2.6 

.22 

.67 

29230 

Electronic  Intercept  Ops  Sped 

294 

82.0 

9.6 

86.5 

2.4 

.33 

.65 

77130 

Air  Policeman 

2233 

55.8 

11.4 

84.9 

3  3 

.25 

.46 

90010 

Medical  Helper 

1832 

73.1 

10.8 

84.2 

4.6 

.35 

.63 

90010 

Medical  Helper  Fundamentals 

323 

77.8 

8.3 

86.5 

4.1 

.25 

.58 

TABLE  14.  Validity  of  AQE-  F  Electronics  AI 
lot  Electronics  Training  Courses 

Course  Number  and  Tide 

N 

Electronics  AI 

Mean  SD 

Final 

School  Grade 

Mean  SD 

Validity 

r  r 

c 

30130 

Aircraft  Radio  Repairman 

112 

75.4 

7.3 

85.2 

1.8 

.31 

.71 

30432 

Ground  Comm  Eqpmt  Rprmn 

127 

75.4 

7.5 

85.7 

2.5 

.39 

.79 

42133 

Acft  Ground  Eqpmt  Rpjmn 

427 

63.6 

12.1 

85.0 

2.3 

.40 

.64 

42230 

Instrument  Repairman 

242 

61.2 

10.6 

85.5 

2.5 

.38 

.66 

42330- 

1  Acft  St  Missile  Electrical  Rprmn 

622 

59.9 

8.8 

85.1 

2.8 

.40 

.75 

4  2333 

Fit  Control/Auto  Pilot  Sys  Rprmn 

352 

60.7 

8.6 

85.4 

2.8 

.28 

.62 
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SECTION  4.  RESEARCH  ON  AIRMAN  SELECTION  AND  CLASSIFICATION  DEVICES 


The  development  of  teat*  for  eirman  (election,  claaaification,  and  proficiency  meaaure- 
ment  is  a  major  part  of  the  mis  sion  of  the  Personnel  Research  Laboratory.  Equally  important, 
however,  is  the  role  of  the  research  program  in  the  overall  effort  of  the  laboratory,  because  with* 
out  research  the  future  tests  would  be  only  replications  of  past  versions.  Keeping  current  with 
the  technology  and  advancing  the  state-of-the-art  are  functions  of  the  research  in  the  total  mission. 

Aptitudt  Test  Studies 

Validation  of  the  AQE  aptitude  indexes  in  predicting  technical  schoAl  grades  is  a  continuing 
effort  as  a  normal  phase  of  the  test  building  process.  There  is,  in  addition,  a  constant  watch  on 
these  validities  with  respect  to  possible  changes  in  combinations  of  subtests  in  the  composites, 
o  r  substitution  of  item  types,  to  maintain  or  improve  the  validity  of  the  composites.  The  possi- 
b  ility  of  changing  the  composite  designated  as  the  selector  index  for  a  given  school  is  ever  pres- 
e  n  t,  since  the  validity  studies  include  analysis  of  all  four  indexes  for  each  criterion. 

Research  on  the  aptitude  test  has  been  directed  to  three  areas.  First,  there  are  those 
studie  s  concerned  with  searching  out  new  test  variance  to  increase  the  predictive  efficiency  of 
an  iolex.  These  studies  take  the  form  of  extensive  experimental  test  batteries  administered  to 
s  tudents  selected  for  specific  courses  of  training  just  prior  to  entry  into  that  training.  The  pur- 
pose  is  twofold:  one,  it  keeps  the  operationally  used  subtests  in  step  with  technological  devel¬ 
opments;  second,  it  permits  exploration  of  new  ways  of  measuring  some  of  the  basic  factors. 

The  second  area  is  that  of  assessing  the  predictive  efficiency  of  the  aptitude  indexes 
against  job  performance.  Identifying  the  airman  who  can  succeed  in  technical  training  is  but 
half  the  task;  it  is  equally  important  to  predict  with  better  than  chance  success  those  men  who 
will  also  perform  well  in  their  job  assignments  after  training. 

The  third  area  of  research  involves  the  mechanics  of  building  and  administering  the  test 
b  atteries.  Such  things  as  test  length,  number  of  different  kinds  of  tests,  ways  of  scoring  and 
combining  scores,  all  related  to  the  amount  of  testing  time  available  and  the  level  of  validity 
acceptable,  are  evaluated.  For  example,  if  a  specific  test  not  presently  in  the  AQE  is  found 
to  have  some  usable  variance,  should  it  be  substituted  in  toto  for  an  existing  test  or  should 
s  h  ortened  forms  of  both  tests  be  used,  and  still  stay  within  a  set  time  limit.  Research  on  the 
e  ffe  cts  of  traihing  in  the  Aviation  High  School  curriculum  on  test  scores  from  test  to  retest  pro- 
vided  some  useful  data  on  possible  improvement  of  abilities  through  training.  Other  test-ret'est 
s  tud  ies  are  in  process  for  application  to  test  notming  and  standardization  and  the  results  may 
well  have  implications  for  other  testing  programs  as  otit  school  age  population  becomes  exposed 
to  mote  and  more  testing. 

As  the  human  being  is  a  dynamic  organism  and  as  our  technology  evolves,  so  then  must 
the  building  of  future  test  forms  incorporate  the  facts  which  become  available  only  through  an 
a  ctive  research  program.* 


Measuring  Personality 

Test  builders  have  done  a  good  job  in  developing  tests  that  measure  learning  apti¬ 
tudes  and  educational  achievement.  The  inventory  of  such  tests  and  the  ci^acity  for  producing 
n  ew  ones  is  limitless.  Emphasis  now  is  in  an  area  where  the  record  has  not  been  good-meas¬ 
ures  of  personality  and  character  traits.  We  want  to  be  able  to  identify  the  man  who  will  work 
effectively  in  a  team,  who  will  stand  up  in  a  crisis,  who  has  a  capacity  for  leadership,  who  can. 
deal  imaginatively  with  Ait  Force  problems 
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Fig.  6.  Correlations  of  personality  ratings  with  efficiency  ratings. 

A  preliminary  approach  has  been  to  get  whole  training  classes  to  select  from  their  fel¬ 
lows  the  ones  that  each  of  a  set  of  adjectives  applies  to:  goodnatured,  assertive,  talkative, 
and  so  on  through  a  long  list.  Such  ratings  have  established  a  group  of  stable  personality 
factors.  Figure  6  shows  that  some  of  them  have  a  strong  relationship  with  efficiency  ratings. 
Now  our  task  is  to  develop  feasible  paper-and-pencil  tests  of  these  factors  by  validating  them 
against  the  highly  reliable  and  stable  peer  ratings. 

Identifying  the  Unsuitable  Airman 

A  look  at  the  records  of  the  100,000  men  inducted  in  1956  showed  that  over  10  percent 
were  dis  charged  as  unsuitable  before  the  end  of  the  first  4-year  tour  of  duty.  The  discharged 
group  were  different  from  the  active^daty  group  on  three  counts.  This  is  a  logical  picture. 

The  younger  boys  haven’t  had  time  for  college.  The  low  aptitude  people  drop  out  of  school 
early.  This  kind  of  information  has  led  the  Air  Force  to  raise  its  education  requirements,  and 
to  emphasize  completion  of  high  school  as  part  of  its  recruiting  effort. 


They  were  younger,  with  a  They  had  less  schooling  -  They  averaged  lower 

high  proportion  of  17-year-olds  only  20%  finished  high  school  on  aptitude  tests 
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Identifying  the  Unreliable  Airman 

A  few  airmen  prove  incapable  of  adjusting  to  Air  Force  life.  Others  may  be  satisfactory 
in  routine  assignments,  but  can't  be  trusted  in  jobs  requiring  a  high  degree  of  personal  respon- 
sibility.  One  i^>proach  to  identifying  these  men  is  based  on  the  simple  premise  that  unreliable 
schoolboys  are  likely  to  be  unreliable  airmen.  To  test  this  assumption,  we  are  questioning 
teachers  and  counselors  of  a  large  group  of  new  airmen  about  their  high  school  history.  These 
men  will  be  followed  through  their  Air  Force  career  to  determine  what  e  laments  in  the  high 
school  history  correlate  with  the  military  record. 

Describing  the  Proficient  Airman 

Our  selection  and  classification  tests  need  to  predict  not  only  success  in  job  training  and 
in  gaining  job  knowledge,  but  the  full  range  of  career  effectiveness.  Probably  no  single  measure- 
peer  ratings,  supervisory  ratings,  written  tests  of  knowledge,  rate  of  increase  in  grade— will  do 
the  full  job.  Some  combination  of  several  measures  may  be  the  solution.  Several  new  measures 
show  promise  as  possible  components. 

Most  Air  Force  jobs  involve  flexible  vork  assignments.  Let’s  assume  that  the  most  capable 
airman  is  assigned  the  most  difficult  tasks.  With  a  suitable  measure  of  task  difficulty  and  a  record 
of  task  assignments,  a  new  proficiency  scale  emerges.  Or  perhaps  the  less  competent  airman  is 
u  sed  on  a  small  range  of  tasks  while  the  best  are  assigned  to  any  task  in  the  job  inventory.  Or 
let's  assume  the  proficient  worker  finishes  a  task  in  half  the  average  time.  Scores  like  these  are 
entirely  feasible  since  electronic  computers  can  be  programmed  to  produce  them  from  information 
routinely  gathered  in  task  inventories. 


Models  for  Data  Analyses 

Advances  in  statistical  analysis  support  all  of  the  test  development  activities.  A  gen¬ 
eralized  linear  regression  model  has  been  developed  and  programmed  for  high-speed  computing 
e  quipment  which  increases  both  the  speed  and  scope  of  data  analyses.  Scientists  respond  to 
the  increased  analytical  ctqjability  by  designing  broad  gauge  attacks.  Instead  of  asking  "Is 
variable  X  related  to  criterion  y?”  they  ask  "Which  of  these  30  variables,  and  in  what  combina¬ 
tions,  are  related  to  what  extent  to  which  of  these  criteria?"  For  answer,  the  scientist  gets 
pages  of  print  out  like  the  sample  in  Table  13. 


TABLE  IS.  Machine  Uetiii{  of  a  Sample  Solution 
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Hodtl*  for  Air  Fore*  Hrmogammti 

The  problem  of  manning  the  Air  Force  ia  analogous  »  the  logistics  of  siq>ply  where 
mathematical  modela  have  provided  the  means  of  simulating  the  operation  of  a  dynamic  ays- 
tem  The  Air  Farce  first  called  on  operations  research  everts  for  a  solution  of  the  personnel 
a  ssignment  problem.  This  line  of  investigation  was  particularly  fruitful  in  providing  a  feasible 
way  of  reconciling  quota  and  personnel  qualification  requirements. 

This  success  suggested  that  mathematical  models  might  be  adapted  to  simulate  the  Air 
Force  personnel  system.  From  one  of  these  models,  a  general  model  of  the  airman  population 
was  developed  and  tested  in  a  feasibility  study.  This  model,  based  on  Markov  chains,  differ¬ 
entiates  the  airmen  into  groups,  or  "states,"  based  on  characteristics  that  determine  job  func¬ 
tions  in  the  Air  Force.  It  permits  projections  to  future  points  in  time  of  the  number  of  airmen 
in  each  state,  and  comparison  of  these  projected  numbers  with  the  needs  forecast  to  exit  at 
that  time.  When  the  forecast  and  estimated  need  are  widely  different,  a  policy  change  is  simu¬ 
lated  and  the  effect  evaluated. 

One  small  part  of  this  model  (which  represents  the  Electronics  Operations  group  of  career 
fields)  is  shown  schematically  in  Figure  8.  Figures  in  the  table  under  the  diagram  show  effects 
of  (a)  continuing  present  personnel  policies;  (b)  adjusting  the  rate  of  input;  and  (c)  adjusting 
retention  at  the  end  of  the  first  enlistment.  With  each  change,  the  expected  numbers  correspond 
more  and  more  closely  to  forecast  needs. 
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Pig.  8.  Simplified  model  of  one  group  of  career  fielda. 
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Thia  model  was  developed  to  make  a  practical  test  of  the  theoretical  model.  It  has  passed 
that  test,  and  now  administrators  are  deciding  what  characteristics  to  include  in  the  model  and 
the  necessary  ptocedurea  for  awift  and  continuoua  data  collection. 

An  extension  that  appears  promising  is  the  combination  of  this  type  of  model  with  others 
to  permit  the  selection  of  a  "best"  or  "optimum"  policy. 

Personnel  research  is,  by  its  nature,  undramatic.  There  are  no  tense  countdowns  or 
spitctacular  ci4>tures  of  vehicles  rettiming  from  space.  On  the  other  hand,  methods  for  meeting 
the  personnel  demands  of  a  new  Air  Force  system  emerge  from  investigation  of  the  system  in 
being.  The  rapidly  increasing  complexity  of  equipment  resulting  from  technological  advances 
requires  highly  competent  personnel  to  design,  operate,  and  maintain  the  systems.  Improved 
tec  hniques  of  job  description,  personnel  selection,  and  assignment  are  necessary  to  meet 
the  se  demands.  Readiness  for  the  new  comes  from  increased  precision  and  speed  of  collect¬ 
ing  information,  making  predictions,  and  verifying  these  predictions.  This  series  of  successive 
refinements  provides  the  means  of  keeping  vp  with  increasingly  demanding  Air  Force  personnel 
needa-never  perfectly,  but  always  closer  to  the  optimum. 
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